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There are n queues, each with a single server. Customers arrive 
in a Poisson process at rate An, where < A < 1. Upon arrival each 
customer selects d> 2 servers uniformly at random, and joins the 
queue at a least-loaded server among those chosen. Service times are 
independent exponentially distributed random variables with mean 
1. We show that the system is rapidly mixing, and then investigate 
the maximum length of a queue in the equilibrium distribution. We 
prove that with probability tending to 1 as n — » oo the maximum 
queue length takes at most two values, which are Inlnn/ Ind + 0(1). 

1. Introduction. We study a well-known queueing model with n separate 
queues, each with a single server. Customers arrive into the system in a 
Poisson process at rate An, where < A < 1 is a constant. Upon arrival 
each customer chooses d queues uniformly at random with replacement, 
and joins a shortest queue amongst those chosen (where she breaks ties 
by choosing the first of the shortest queues in the list of d). Here d is a 
fixed positive integer. Customers are served according to the first-come-first- 
served discipline. Service times are independent exponentially distributed 
random variables with mean 1. 

A number of authors have studied this model before, as well as its exten- 
sion to a Jackson network setting [2, 3, 4, 11, 13, 14, 15, 17]. For instance, 
it is shown in [2] that the system is chaotic, provided that it starts close to 
a suitable deterministic initial state, or is in equilibrium. This means that 
the paths of members of any fixed finite subset of queues are asymptotically 
independent of one another, uniformly on bounded time intervals. This re- 
sult implies a law of large numbers for the time evolution of the proportion 
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of queues of different lengths, that is, for the empirical measure on the path 
space [2]. In particular for each fixed positive integer ko, as n tends to infin- 
ity the proportion of queues with length at least /cq converges weakly (when 
the infinite-dimensional state space is endowed with the product topology) 
to a function vt{k()), where ft(0) = 1 for all t > and {vt{k) : /c G N) is the 
unique solution to the system of differential equations 

(1) = X{vt{k - ly - vtikf) - {vt{k) - vt{k + 1)) 

for € N. Here we assume appropriate initial conditions (vQ^k) : A; € N) such 
that 1 > vq(1) > vq{2) > • • • > 0. Further, again for a fixed positive integer 
ko, as n tends to infinity, in the equilibrium distribution this proportion 
converges in probability to A^"*"'^"' ^ , and thus the probability that a 

given queue has length at least ko also converges to A^"'"'^"' ^ . 

Although these results refer only to fixed queue length ko and bounded 
time intervals, they suggest that when d>2, in equilibrium the maximum 
queue length may usually be O (In Inn). Our main contribution is to show 
that this is indeed the case, and to give precise results on the behavior of 
the maximum queue length. In particular, we shall see that when d>2, 
with probability tending to 1 as n — oo, in the equilibrium distribution 
the maximum queue length takes at most two values; and these values are 
Inlnn/lnc? -|- 0(1). We show also that the system is rapidly mixing, that 
is, the distribution settles down quickly to the equilibrium distribution. An- 
other natural question concerns fluctuations when in the equilibrium distri- 
bution: how long does it take to see large deviations of the maximum queue 
length from its stationary median? We provide an answer by establishing 
strong concentration estimates over time intervals of length polynomial in 
n. Our techniques are partly combinatorial, and are used also in [7, 8, 9]. In 
particular, in [8] we use the concentration estimates obtained here to estab- 
lish quantitative results on the convergence of the distribution of a queue 
length and on the asymptotic independence of small subsets of queues, the 
"chaotic behavior" of the system. 

Recently, in [6, 10], a quantitative approximation has been obtained for 
the supermarket model, including a law of large numbers and a central limit 
theorem. These results rely on properties of continuous-time exponential 
martingales and strong approximation of Poisson processes by Brownian 
motion. A "localization" technique yields tight bounds on the deviation 
probabilities uniformly in all co-ordinates of the infinite-dimensional state 
space, in a spirit somewhat akin to the approach adopted in this paper and 
in [7, 8, 9]. However, the results in [6, 10] concern solely fixed-length time 
intervals and do not extend to equilibrium behavior. 

Let us introduce some notation so that we can state our results. Consider 
the n-queue model. For each time t >0 and each j = 1, . . . ,n let X^'^\j) 
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or Xt{j) denote the number of customers in queue j, always including the 
customer currently being served if there is one. (We shall keep the superscript 
"n" in the notation in this section, but then drop it in later sections.) We 

(n) 

make the usual assumption of right-continuity of the sample paths. Let 
or Xf be the queue-lengths vector (x}"^ (1), . . . , xj:^^ (n))- For a given positive 
integer n, xj:""^ is an ergodic continuous-time Markov chain. Thus there is 
a unique stationary distribution 11 or 11 for the vector of queue lengths; 
and, whatever the distribution of the starting state, the distribution of the 
queue-lengths vector x|"^ at time t converges to 11^"^ as t — > oo. We will 
show that, with reasonable initial conditions, the convergence is very fast. 
Note that the Li-norm ||Xf ||i of Xf is the total number of customers present 
at time t, and the Loo-norm ||Xt||oo is the maximum queue length. 

The probability law or distribution of a random variable X will be denoted 
by C{X). The total variation distance between two probability distributions 
fj.1 and fi2 may be defined by dTvl^ii /^2) = sup^ |Pr(X S vl) — Pr{Y € 
where the supremum is over all events A, or equivalently by c^tv (^11/^2) = 
inf Pr(X ^ Y), where the infimum is over all couplings of X and Y where 
C{X) = ^ii and C{Y) = fi2- 

For any given state x we shall write C{X^'^\x) to denote the law of xj:"'^ 
given Xq^^ = x. For e > 0, the mixing time r^")(e, x) starting from state x 
is defined by 

T('")(e,x) = inf{i > 0:dTv(/:(xf \a;),nW) < e}. 

Our first theorem shows that if we start from any initial state in which the 
queues are not too long, then the mixing time is small. In particular, if e > 
is fixed and denotes the all-zero n-vector, then T^"'\e,0) is O(lnn). More 
generally, this holds if e > is not too small (explicitly, if is bounded 
polynomially in n), \\x\\i is 0{n) and ||x||oo is O(lnn). Observe that the 
quantity 5n,t below is if the initial state is 0. 

Theorem 1.1. Let < A < 1 and let d be a fixed positive integer. For 
each constant c > there exists a constant rj > such that the following 
holds for each positive integer n. Consider any distribution of the initial 

(n) 

queue-lengths vector Xq , and for each time t>0 let 

5n,t = Pr(||4") 111 > cn) + Pr(||4") ||^ > r^t). 

Then 

dTv(>C(X^"^),n(")) < ne-^* + 26-'?" + 5n,t. 
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The O(lnn) upper bound on the mixing time r is of the right order. 
Indeed, we shall see that for a suitable constant ^ > 0, if t <9lnn, then 

(2) dTv(>C(X^"^),n(")) = 1 - e-^^i'^'"). 

Thus rW(e,0) is e(ln n) as long as both e ^ and (1 — e) ^ are bounded 
polynomially in n. 

(n) (n) 

Our primary interest is in the maximum queue length = \\X^ \\oo- 

Since the system mixes rapidly it is natural to consider the stationary case. 
Our model exhibits the "power of two choices" phenomenon (see, e.g., [15]); 
that is, when we move from d= 1 choice to d = 2 choices, the typical maxi- 

(n) 

mum queue length drops dramatically. 

We are most interested in the case d>2, but first we consider the easy 
case d = 1 in order to set the scene. This case is straightforward, since in 
equilibrium the queue lengths are i.i.d. geometric random variables with 
parameter A. We find that the maximum queue length M^""^ is about i^^Jx) ' 
and it is not concentrated on a bounded range of values (in contrast to 
the behavior in the balls-and-bins model [7], where the maximum load is 
concentrated on at most two adjacent values, even when d=l). 

Given a sequence of events Ai,A2,...,we say that An holds asymptotically 
almost surely (a.a.s.) if An holds with probability tending to 1 as n — > oo. 

Theorem 1.2. Let < A < 1 and let d= 1. For each positive integer n, 

(n) 

suppose that the queue-lengths vector Xq is in the stationary distribution 
(and thus so is the maximum queue length M^""^ ). 

(a) For each nonnegative integer m 

Pr(Mt^") < m) = (1 - A™+^)". 

Thus ifm = m{n) and n — > oo, then M^"'^ > m{n) a.a.s. if and only ifm{n) — 
in'i/A) ~^ —oo; and Mj"^ < m{n) a.a.s. if and only if m{n) — i^^ljx) ~^ +oo. 

(b) For any subexponential time r > (i.e., r = e""'^' J, 

( min m/"'''^ — ^ ^ ^ 1 in probability as n ^ oo. 
\0<t<T * y Inn ^ ^ 

(c) For any constant K > 0, 

( max Afi"^^ — [ ^ ^ ^ K +1 in probability as n ■ 
\0<t<nii J mn 



oo. 



in) 

Now we consider the case d>2, when the maximum queue length Mf' 
is far smaller, and it is concentrated on just two values and — 1- This 
is our main result. 
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Theorem 1.3. Let < A < 1 and let d>2 be an integer. Then there ex- 
ists an integer-valued function = md{n) = lnlnn/ln(i+0(l) such that the 
following holds. For each positive integer n, suppose that the queue-lengths 
vector Xg"^ is in the stationary distribution (and thus so is the maximum 
queue length Alj^"'^ ). Then for each time t>0, M^"'^ is md{n) or md{n) — 1 
a.a.s.; and further, for any constant K >{) there exists c = c{K) such that 



The functions m2(n), m3(n), . . . may be defined as follows. For d = 2, 3, . . . 
let irf(n) be the least integer i such that A'-"'*"^^/'-'^"^^ < n~^/'^\T? n. Then we 
let m2{n) = i2{n) + 1, and for d > 3 let md{n) = id{n). (We shall see that 
with high probability the proportion of queues of length at least i is close 



Results can be obtained on deviations of the maximum queue length over 
longer time intervals, using arguments just as in [7]; we shall not discuss 
such results further here. 

We have now described our model and stated our main results. The later 
sections of this paper are organized as follows. In Section 2 we prove Theo- 
rem 1.1, which shows that for each fixed positive integer d the process {xj:"'^) 
starting from a nice initial state mixes in logarithmic time. The proof is based 
on considering a pair of "adjacent" initial states and analyzing a suitable 
random walk. We give also a similar result involving the Wasserstein dis- 
tance. In Section 3 we focus on the straightforward case d = 1, and prove 
Theorem 1.2. In Section 4 we show that a Lipschitz function of the queue- 
lengths vector in equilibrium is tightly concentrated around its mean. To do 
this, we consider a queue- lengths process (X^^^) starting from 0, and use 
the bounded differences approach to establish concentration at a suitable 
time t when C{X^'^^) is close to the equilibrium distribution. In Section 5 
we use the concentration property to estimate the proportions of queues of 
at least some given lengths, and to bound their fluctuations over long time 
intervals. In the short Section 6 that follows we establish the logarithmic 
lower bound (2) on the mixing times in Theorem 1.1. In Section 7 we prove 
Theorem 1.3, and thus complete the proofs of the new results stated above. 
Finally, we make some brief concluding remarks. 

Several times we shall use the fact that, if X is a binomial or Poisson 
random variable with mean /i, then for each < e < 1 we have 



(3) 



max I M. 

0<t<n^ 



In Inn/ In (i| < c 



a.a.s. 



to aK-i)/('^-i).) 



(4) 



Pr(X - /i < -ei^i) < e-(^/2)£V 



and 



(5) 



Pr{X - fi>efi) <e 



(l/3)eV. 
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and if X > 2e/i, then 

(6) Pr(X>x) <2-^'. 

For the above results, see, for example. Theorem 2.3(b) and inequalities (2.7) 
and (2.8) in [12]. 

2. Rapid mixing: proof of Theorem 1.1. In this section we shall in fact 
prove both Theorem 1.1 and a similar result involving the Wasserstein dis- 
tance instead of the total variation distance. The Wasserstein distance may 
be defined by (iw(A*i)/^2) = inf E[||X — ^||i] where the infimum is over all 
couplings where C{X) = ni and C(Y) = fi2- Observe that for integer- valued 
random variables, the total variation distance between the corresponding 
laws is always at most the Wasserstein distance. The following result will 
also be used in [8], where we consider the asymptotic distribution of a queue 
length. 

Lemma 2.1. Let < A < 1 and let d be a fixed positive integer. For each 
constant c > there exists a constant i] > such that the following holds 
for each positive integer n. Let M denote the stationary maximum queue 
length. Consider any distribution of the initial queue-lengths vector Xq such 
that ||Xo||i has finite mean. For each time t>0 let 

Sn,t = 2E[||Xo||il||Xo||i>cn] + 2cnPr(Mo > r,t). 

Then 

dw{C{Xt),U) < ne-'i* + 2cnPr(M > rjt) + 2e-i'' + 6n,t- 

In order to prove this result we shall couple the queue-lengths process 
(Xt) and a corresponding copy (Yj) of the process in equilibrium in such a 
way that with high probability \\Xt — Yt\\i decreases quickly to 0. We model 
departures by a Poisson process at rate n together with an independent 
selection process that generates a uniformly random queue at each event 
time. If the queue selected is nonempty, then the customer currently in 
service departs; otherwise nothing happens. 

We start the proof with a lemma concerning the return times to the origin 
of a generalized random walk on {0, 1,2,...}. This lemma will be needed later 
to show that a certain coupling happens quickly. 

Lemma 2.2. Let <po,4'ij4'2, ■ ■ ■ be a filtration. Let Zi,Z2, . . . be {0, ±1}- 
valued random variables, where each Zi is (j)i-measurable. Let So>0 a.s. and 
for each positive integer j let Sj = Sq + Yli=i ^i- Aq,Ai, . . . be events, 
where each Ai is (j)i-measurable. 
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Suppose that there is a constant positive integer ko and a constant 6 with 
< (5 < 1/2 such that 

Pr{Z, = -l|0,_i) >5 on Ai_i n {Si^i e{l,...,ko- 1}} 

and 

Pr{Zi = > 6+1/2 on Ai^i n {Si^i > ko}. 

Then there exists r] > such that for each positive integer m 

Pr 1^ 1^ f) 5, / 0^ n P ^ < Pr(So > r?m) + 26"^"^. 

Proof. Let us ignore the events Ai in the meantime; we shall see later 
that it is easy to incorporate them into the argument. We define random 
times Ij and Ij as follows. Let 

/q = min{i >l: Si < ko}, 

and let 

Ij+i = min{z > Ij : Si < ko}. 

Further, let Iq = Iq and let 

/j+i = min{i > Ij + ko : Si < ko}- 

Observe that always Ij < Ik^j . 

The key fact is that for all positive integers m and j, 



(7) Pr (^f]Si^O^ <{1- 6''y + Pr(/j > m). 

To see this, note first that if /j = t, then St < ko and, for 1 < k < ko, on 
St = kwe have 



Pr(^f]{Zt+u = -l)\4>t^>S' 



Now for each i = 0, 1,... let Bi be the event that Sr for each r = 
i^,...,i^ + ko-l. Then Pr (Si 1 0^-. ) < 1 - 6''° , and so Pr (flto B^)<{l-6''° y . 
But 



Pr (^(^(\ Si ^0^ 0(1, <m)^ <Pr(Y]B,^, 



and (7) follows. 
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We need to investigate the times Ij in order to be able to ensure that the 
term > m) in (7) is smah. First we consider the times Ij. Note that 

§ < (1 — + 6) for r > 0. Let h = (5^/4. Then by (4), for all nonnegative 
integers j and r, 

Pr(/,+i - > r\cf>i^) < Pr (^i?(^r, 1 + 5^ < < e''^^ 

(Here we are using B to denote a binomial random variable.) Now let s be 
a positive integer. Let b = [6 — 26'^)"^, so 6 > 0. Note that for r > bs, we 
have ^ (1 — '^)^(^ + Hence, again using (4), we see that, on the event 
{So < s}, 

Pr(/o > r|0o) < Pr(^i?(^r, ^ + 5^ < ^) < e- 

Thus in particular, for r >bs, 

Pr(/o >r)< e-^"' + Pr(5o > s). 

Let Z he a random variable taking positive integer values and such that 
Pr{Z > r) = e~^''' for each positive integer r. Then Ij — Iq is stochasti- 
cally at most the sum of j i.i.d. random variables, each distributed like Z. 
Note that Mz{h/2) = E[e(''/2)^] < oo. Let ci > be sufficiently large that 
Mz{h/2)e-''^^/'^ < 1, say Mz{h/2)e~''^^/'^ = e'"^ where C2 > 0. Then 

Pr(/,- - /o > cij) < e-('^/2)'=i^E[e(^/2)(/,-/o)] 

Putting the last two results together, and using the fact that Ij < Ijko-, we 
have for each r >bs, 

Pr{ij >r + cijko) < Pr(/o > r) + Fr{Ijko -Io> cijko) 

<e-'^'' + Pr(5o>s) + e-"2^'^o. 

We may now complete the proof (still for the case without the events Ai). 
Let ryi > and ry2 > be sufficiently small that 1 — ?/i — r]2Ciko > 0. Let r = 
[riim] , j = \r]2m'\ and s = [r/ftj . Then for m sufficiently large, r + cijkQ < m; 
and so by (7) and the last inequality 



Pr ( Pi 5, / j < e-^'^"' + e-^"" + Pr(5o > s) + e-^^jfco 



SUPERMARKET MODEL 9 

Thus there exists a constant r]' > and an integer mo such that for each 
integer m > mo 

Pr(^f]Si^oj < Pr(5o > rj'in) + 26"''''". 

But now we may set r] = minj??', ln2/mo} > and then for each positive 
integer m 

Pr (^f\ Si ^ < Pr(5o > r?m) + 2e~^'". 

Let us now bring in the events Ai. For each i define Zi = ZilA^ — 

(where Ai denotes the complement of Ai). Then Pr{Zi = — > 5 on 
{Si.i G {1, . . . , ko - 1}} and Pr(Zi = > 1/2 + 5 on > ko}. Let 

Sj = So + J2i=i ^i- Then by what we have just proved applied to the Zi, 

Pr(^(^n5i/o^ n(Aon---n^„,_i)^ <Pr|^n^,/o^ 

<Pr(5o>7?m) + 2e-''™, 

as required. □ 



We now introduce a natural coupling of n-queue queue-lengths processes 
(Xt) with different initial states. 

Arrival times form a Poisson process at rate An, and there is a corre- 
sponding sequence of uniform choices of lists of d queues. Departure times 
form a Poisson process at rate n, and there is a corresponding sequence of 
uniform selections of a queue, except that departures from empty queues 
are ignored. These four processes are independent. Denote the arrival time 
process by T, the choices process by D, the departure time process by T 
and the selection process by D. 

Suppose that we are given a sequence of arrival times t with corresponding 
queue choices d, and a sequence of departure times t with corresponding 
selections d of a queue, where all these times are distinct. For each possible 
initial queue-lengths vector x E $7 = (Z"*")" this yields a deterministic queue- 
lengths process (xt) with xq = x: let us write xt = st(x; t, d, t, d). Then for 
each X € ri, the process (sj(x; T, D, T, D)) has the distribution of a queue- 
lengths process with initial state x. 

Lemma 2.3. Fix any 4:-tuple t,d,t,d as above, and for each x G write 
st{x) for st(x;t,d,t,d). Then for each x,y G both \\st{x) — st{y)\\i and 
||sf(x) — st{y)\\oo are nonincreasing; and further, if <t <t' and st{x) < 
stiy), then st'{x) < st'{y). 
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(We shall not need the result about ||sf(x) — st{y)\\oo in this paper, but it 
is convenient to record the result for use elsewhere, in particular in [8].) 

Proof of Lemma 2.3. Let to be a jump time; let xt^- = x and yt^- = y; 
and let xt^ = x' and yt^^ = y' . 

Suppose that to is an arrival time. We want to show that 

(8) \\x' -y'\\i<\\x -y\\i 
and 

(9) \\x' - y'Woo < \\x - y\\oo- 

If the customer joins the same queue in the two processes, then of course 
x' — y' = X — y, and hence (8) and (9) hold. Suppose that the customer joins 
queue i in the x-process and joins queue j in the y-process, where i j. 
Then 6x = x{j) — x{i) > and 5y = y{i) — y{j) > 0; and by the tie-breaking 
rule Sx + 6y > 0. 

Suppose first that (8) does not hold. Then we must have x{i) > y{i) and 
y{j) > x{j), and so 

x{i) > y{i) = y{j) + 5y> x{j) +6y = x{i) + 4 + Sy> x{i), 

a contradiction. Hence (8) must hold. 

Now suppose that (9) does not hold. Then either x{i) — y{i) = \\x — y\\oo 
or y{j) ~ x{j) = \\x — y\\oo- But we cannot have x{i) — y{i) = \\x — y\\oo-, since 

x{j) - y{j) = x{i) +6x- {y{i) - 5y) > x{i) - y{i). 

Similarly we cannot have y{j) — x{j) = \\x — y\\oo-, and so (9) must hold. 

Suppose now that to is a departure time, from queue i. If both queues are 
nonempty or both are empty, then x' — y' = x — y, and hence of course (8) 
and (9) hold. If exactly one queue is nonempty, then \x[ — y^\ = \xi — yi\ — 1, 
and so again (8) and (9) hold. 

The final comment on monotonicity is straightforward. For consider a 
jump time to with x,x',y and y' defined as above, and suppose that x <y. 
If to is a departure time, then clearly x' < y' , so suppose that to is an 
arrival time. But if the new customer joins queue i in the x-process and if 
x{i) = y{i), then the customer joins queue i also in the y-process, so x' < y' . 
□ 

The position of a customer refers to first-in-first-out queue discipline; that 
is, for a given customer in queue j at time t, her position is one plus the 
number of customers in queue j at time t who arrived before her. Given a 
queue-lengths vector x and a nonnegative integer i, let i{i,x) be the number 
of queues with length at least i. We shall be interested in i(i, Xt), the random 
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number of queues with length at least i at time t. Observe that if ||x||i < ere, 
then i{i,x) < cn/i: this is how we shall ensure that i{i,Xt) is not too large. 

Next, let us consider the equilibrium distribution, and note some upper 
bounds on the total number of customers in the system and on the maximum 
queue length, which follow from the easy case d=l. 

Lemma 2.4. (a) For any constant c > there is a constant rj > such 
that for each positive integer n, in equilibrium the queue-lengths process (Xt) 
satisfies 

Pr(||Xt||i >cn) <e-''" 

for each time t>0. 

(b) For each positive integer n, in equilibrium the maximum queue length 
Mt satisfies 

Pr(Mt > A;) < nX'^ 
for each positive integer k and each time t>0. 

Proof. For both parts of the lemma, it suffices to consider the case 
d= 1; for, as follows from a coupling result in [16] (see also [3]), if d < d' , 
then in equilibrium for each k the number of customers with position at 
least k with d' choices is stochastically at most the corresponding number 
with d choices. (Note that the maximum queue length Mt is at least k if 
and only if at time t there is at least one customer with position at least k.) 
So, suppose that d = l. 

But now by the splitting property of the Poisson process the n queue 
lengths Xt{j) are independent; and each has the geometric distribution 
where Pr(Xt(j) = /c) = (1 — A)A'^, with mean A/(l — A). Thus the total num- 
ber of customers is a sum of re i.i.d. random variables with finite moment- 
generating function in some neighborhood of 0, and part (a) follows easily. 
For part (b), note that 

Pr(Mt >k)< rePr(Xt(l) >k)= nX^ . □ 

The bound in part (a) above extends easily over time. 

Lemma 2.5. Let c > be a constant. Then there is a constant rj > 
such that for each positive integer n, in equilibrium the queue-lengths process 
(Xt) satisfies 



Pr(||Xt||i > ere for some t € [0,e''"]) < 26"''". 
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Proof. Let < c' < c and let e = c — c' > 0. By part (a) of the last 
result, there exists a constant rj > such that for each positive integer n 
and each t > we have Pr(||Xt|[i > c'n) < e"^''"; and we may assume that 
r]<e/l8. 

Let 6 = e/2X. Let j = \e^^ /5~\ , and consider times tr = r5, for r = 0, . . . , j. 
The mean number of arrivals in a subinterval [tr-i,tr) of length 6 is en/2, 
so by (5) the probability that more than en arrivals occur is at most e~^"/^. 
Then 

Pr(||Xt|li > cn for some t G [0,e''"]) 

j j 
< '^Fr{\\Xt^\\-^ > c'n) + ^ Pr([tr-i, ^r) has > en arrivals) 

r=0 r=l 

provided n is sufficiently large, and the lemma follows (for a suitable new 
value of r/). □ 

We say that two states are adjacent if they differ by adding one customer 
to one of the queues in one of the states. The following lemma shows that 
two queue- lengths processes (Xf) and (Xj-) will coalesce rapidly if Xq and 
X'q are adjacent, the "unbalanced" queues are not too long and the total 
numbers of customers are not too large. 

First we fix some constants. Let < A < 1 and let dhe a positive integer. 
Let c > jzTx: and let 77 > be as in Lemma 2.5. (This will cause no loss 
of generality, as the case c > of course implies the case c < in 
Theorem 1.1.) Let e > satisfy = dXe'^"^ < 1. Let /cq = \2c/e]. We shah 
keep all these constants fixed from now on, until the end of the section. 

Lemma 2.6. There exist constants a,(3 > such that the following holds. 
Let n be a positive integer. Let x,x' be a pair of states such that x{k) = 
x'{k) — 1, x{j) = x{j) for all j 7^ k, and \\x'\\i < cn. Consider the queue- 
lengths processes (Xf) and {Xj^), given that Xq = x and X'q = x' . For all 
times t > a||x'||oo have 

E||Xj - X[\\i = Pr(Xf ^ Xi) < e"^* + 26"^". 

Proof. By Lemma 2.3, Xt and X^ are always either neighbors or equal, 
always Xt < X[, and if for some time s we have Xg = X'g, then Xt = X[ for 
alH > s. Thus in particular ¥,\\Xt- X[\\i = Y'v{Xt^ X[). 

Initially, the queue k is "unbalanced" [i.e., XQ{k) 7^Xq(A;)] and all other 
queues are "balanced." Observe that the index of the unbalanced queue in 
the coupled process may change over time. [E.g., suppose that d = 2, and 
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just before an arrival time t, queue i is unbalanced, and queues i and j are 
chosen. Suppose further that Xj._{i) = X[_{j) or Xt^{i) =Xt-{j). In the 
former case we select queue i for the {Xt) process, but we will select queue j 
for the {X[) process if we chose j before i. In the latter case we select queue 
j for the {X[) process, but we will select queue i for the {Xt) process if we 
chose i before j. In both cases, it will now be queue j that is unbalanced.] 

Let Wt denote the longer of the unbalanced queue lengths at time t if there 
is such a queue, and let = otherwise. The time for the two processes 
to coalesce is the time T until Wt hits 0. We shall use Lemma 2.2 to give a 
suitable upper bound on Pr(VFf > 0). The idea is that with high probability 
the total number of customers in the system is not too large, hence the 
unbalanced queue length Wt will often be driven below /cq, and then there 
is a chance of going all the way down to 0. 

For each time t > let Bt be the event that ll-^^^Hi < 2cn for each s G [0,t). 
It follows from Lemmas 2.3 and 2.5 that there is a constant > such that 
Pr(i?() < 2e~''" for each positive integer n and each time t € [0, to]) where 
to = e''". To see this, note that if (Xf ) is a copy of the process such that 
Xq = a.s., then there is a coupling such that \\X[ — X^\\i < cn for all times 
t > 0. But then we can couple {X't) with an equilibrium process (Xt) so that 
X't < Xt for ah times t > 0, and thus Pr(||Xf ||i > cn for some t G [0, to]) < 
2e-''". Finally, if ||i < cn and \\X^ - ||i < cn, then ||X;||i < 2cn. 

We need some notation concerning the jumps in the unbalanced queue 
length Wt- Let Nt be the number of such jumps in the interval [0,t]. Also 
let = Nt, the total number of these jumps. Let Tj be the time of the jth 
jump if iV > j, and otherwise let Tj be the coalescence time T. 

Let So = x'{k) = Wq, the longer unbalanced queue length at time t = 0. 
For each positive integer j, if N >j, let Sj = Wt^, which is either or the 
longer of the unbalanced queue lengths at time Tj, immediately after the 
jth arrival or departure at the unbalanced queue. Also, if N > j, let Zj be 
the zbl-valued random variable Sj — Sj-i. For each nonnegative integer j, 
let be the fj-field generated by all events before time Tj^i. Let also Aj 
be the -measurable event Btj^^- 

Let 

A ■ f 1 1 H 
= mm< — , >, 

UA + liz + l 2J 

and note that 5 > since < z/ < 1. We shall use Lemma 2.2, with this value 
of 5. Note first that the arrival rate at the longer of the unbalanced queues 
is always at most dX, and the departure rate is 1. Thus on the event N >j 
we have 

Pr(Z, = -l|</.,_i)>-^>5. 
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The key observation is that, on the event {N > j} n Aj^i n {-Sj-i > ko}, we 
have 

Pr(Z, = -l|0,„i)>-l^>^ + 5. 

For consider a time t>0. Note that on Bt we have l(kQ,X')-_) < 2cn/ko < en, 
that is, there are at most en queues with length at least ko. Suppose that 
T > t, Bt holds and Wt > k^. Arrivals into the system occur at rate nA, and 
the probability that such an arrival joins the longer unbalanced queue is at 
most ^e'^~^ . Hence the rate of arrivals at the longer unbalanced queue is at 
most v = dAe'^"^, whereas the rate of departures is 1, and so the next jump 
is a departure with probability at least ^j^. 

We have now shown that on the event N >m, Sm — Sq can be written 
as a sum J2iLiZi for {— 1, l}-valued random variables Zi that satisfy the 
conditions of Lemma 2.2, with the same notation for 6, etc. Hence there 
exists a constant rji > 0, such that for all m > niQ = \ri^^x'{ky\ 

Pr (^{N > ?n} n p A^f^[j] {S., 0}) ) < 2e"''^'"- 

Let n be sufficiently large that 2niQ < tg = ) l^t t satisfy 2mo <t<tQ and 
let m = [t/2\ . Then, since jumps occur at rate at least 1 while the queue is 
nonempty, by (4) 

Pr({T >t}n {Nt < m}) < e^*/^ 

Also, 

Pr (^{Nt > m} n 1^ y :4l^ ^ < Pr (Bt) < 26""". 
This gives the desired upper bound on Pr(T > t), since 

Pr(r >t)< Pr({r >t}n {Nt < m}) + Pr (^{Nt > m} n ^ |J ^ 

+ Pr(^{Nt>m}n(^f] A.^n(^f]{Si^O}^y 

Thus we have shown that 

Pr{Xt / X^) < e-^* + 26-^"^ 

whenever 2mo < t < to • 

Now we check that we can drop the upper bound Iq on t. For let n be 
sufficiently large that e"^*" < e"'^". If t > toi then 

Pv{Xt + X't) < PriXt, + X;j < 3e-^^ 
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and so 

Pr{Xt + X[) < e-f^' + 36-^^" 

for all t > 2mo. 

Finally, by replacing (3 with a smaller constant (3 > 0, we can replace 3 by 
2, and ensure that the inequality holds for all positive integers n, not just 
for sufficiently large n. □ 

Recall that we have fixed a constant c > A/(l — A) and that we are using 
the coupling introduced before Lemma 2.3. 

Lemma 2.7. Let a and [3 he as in the last lemma. Let (Xt) and (Yt) 
have any initial distributions. Let t>0, and let the ^^bad" set B be the set 
of z gQ,= (Z"*")" such that \\z\\i > cn or \\z\\oo > ta~^ . Then 

n\\Xt - ydlil{XoeB}n{yoeB}] < 2cn(e-^* + 26"^"). 

Proof. Given two distinct states x and y in B = Q\ B, we can choose 
a path X = zq, zi, . . . , Zm = y of adjacent states in B from x down to the all 
zero state and back up to y, where m < \\x\\i + ||y||i. Let us write (Xf ) to 
denote the queue-lengths process starting at x, and similarly for (1^^) (so in 
fact X^ = always). By the last lemma, for all states x and y in B 

m—l 

n\\Xf - Yy\\i] < E - ill] < (llxlli + ||y||i)(e-^* + 2e-^n- 

i=0 

Hence the lemma follows. □ 

We may now complete the proofs of Theorem 1.1 and Lemma 2.1, by 
taking (Yt) to be in equilibrium, with Xq and Yq independent, and handling 
the "bad" initial states appropriately. Consider first Theorem 1.1. Note that 

dTy{CiXt),U)<Pr{Xt^Yt) 

< E[\\Xt - l^t||il{Xoe5}n{yoeB}] + Pr(Xo e B) + Pr(yo G B). 

But Pr(||yo||i > cn) = e~'^("') (see Lemma 2.5), since c > A/(l - A). Also, 
from (25) in Section 5, for each j G {1, . . . ,n} and each nonnegative integer 
i, Pr(lo(j) > ^) < A'; and it follows that 

Pr(||yo||oo>to-')<ne-^W. 

Theorem 1.1 now follows from Lemma 2.7. 
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Finally let us complete the proof of Lemma 2.1. Note that dYj{C{Xt),Tl) < 
E[||Xf - Yt\\i]. We break E[||Xt — Yt\\i] into the sum of two parts 

B[\\Xt - YtWil^^^^-^y^^YaeB}] + - yt\\i'i-{XoeB}u{YoeB}]- 

The first part is bounded in Lemma 2.7. For the second, we have by Lemma 2.3 
that 

E[\\Xt - Yt\\il{Xo£B}u{YoeB}] 

< E[\\Xo - Yo\\il^XoeB}u{Yo&B}] 

< E[(||Xo||l + ||'i^o||l)(l||Xo||i>cn + l|jXo||i<cn,||yo||i>cn)] 

+ E[(||Xo||l + ||>o||l)l||Xo||i<cn,||yo||i<cn,max{||Xo||oo,||yo||oo}>to-i] 

<E[||Xo||il||Xo|K>cn]+E[||yo||i]Pr(||Xo||i>cn) + mPr(||yo||i>cn) 

+ E[||yo||il||yo|K>cn]+2cn(Pr(||Xo||oo>to"') + Pr(||yo||oo>to~')), 

where the last inequality uses the independence of Xq and Yq. Now we 
may use the estimates above concerning Yq, together with the fact that 
E[||lo||i] ^ T^^' *° complete the proof. (Note that 

E[||yo||i]Pr(||Xo||i > cn) < ^nPr(||Xo||i > cn) < E[||Xo||il|,Xo|U>cn] 
since c > . ) 

3. One choice: proof of Theorem 1.2. Let < A < 1 and let d = 1. Let 

Xq be in equilibrium. 

Part (a). The queue lengths Xt{j) for j = 1, . . . ,n are independent geo- 
metric random variables with parameter A, and so Pr{Xt{j) > m) = A™' for 
each nonnegative integer m. Hence 

Pr(Mt <m) = (l-A'"+^r, 

and so 

(10) exp(-nA™+V(l - < Pr{Mt <m)< exp(-nA™+^). 

The rest of part (a) follows easily. 

Part (b). The proofs we give for parts (b) and (c) are similar to the 
proofs of the corresponding parts of Theorem 1.2 in [7]. Let V = mino<t<T Mt. 
Let e > 0, let m = m{n) = [(1 - g) i^^Jx) J ^'"■'^ ^ ^ Consider the 
times i9 for i = 0, 1, . . . , . Let A be the event that Mig < m for some 
i G {0, 1, . . . , \T/e'\]. We have nA"^ = O(n^), and hence by (10) 

Pr(^) < {t/6 + 1) exp(-nA'") = o(l). 
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Let B be the event that some queue receives at least two customers in 
some time interval [i9, {i + 1)0), where i € {0, 1, . . . , }. For each queue, 
the number of arrivals in the interval [iO,{i + 1)^) is Po{X9), and so the 
probability that there are at least two arrivals is at most (A0)^. Hence 

Fr{B) < (t/O + l)n{X9)^ = OinrO) = o(l). 

But 

Pr(y <m-2)< Pr(A) + Pr(B), 
and so y > ?Ti — 1 a.a.s. But by part (a) 

In Ti 

and part (b) follows. 

Part (c). Let Z = maxg<^<„x Mf. Let e > 0. We show first that 

In Ti 

(11) ^-^^^^^'^h[(r/xj 

We argue much as in the proof of part (b). Let = exp(— Inn/ Inlnn). 
Consider the times i9 for i = 0,1, . . . , /9~\ . Let k = k{n) = \[K + 1 + 
e/2) Inn/ ln(l/A)] , and let A be the event that Mjg > k for some i G {0, 1, . . . , 
/9~\}. Then since Pr(Mo >k)< , 

Pr(A) < {n^/9 + l)n\^ 

= exp{{K + 1 + o(l)) Inn - (K + 1 + e/2 + o(l)) Inn) 

= exp(-(e/2 + o(l))lnn) 

— > as n — > cx). 

For each queue, the number of arrivals in the interval [i9, {i + 1)9) is Po{\9), 
and 

Pr(Po(A0) >lnn/(lnlnn)2) < (A0)1>^"/(i°1'^")' 

= exp(-J7(ln^ n/(lnlnn)^)). 

Thus, if B is the event that some queue in some interval [i9, {i + 1)^) where 
i € {0, 1, . . . , [n^/0]} receives at least lnn/(lnlnn)^ customers, then 

Pr(S) = exp(-0(ln2 n/(lnlnn)^)). 

But, for n sufficiently large, 

/ In n \ 

Pr Z>(K + l + £)——] <PrM) + Pr(B)^0 as n ^ oo, 
V ln(l/A)/ 
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and so (11) holds. 

Now let < e < 1, and let k = k{n) = [(iT + 1 - e) Inn/ ln(l/A)] . We will 
show that Z >k a.a.s., which will complete the proof of this part and thus 
of the theorem. For each time t > 0, let <j)t be the cr-field generated by all 
events until time t. Let c > A/(l — A). Let C be the event that ||i < cn for 
each t G [0,n^]. Then C holds a.a.s. by Lemma 2.5. Also, by Theorem 1.1 
there are constants uq and ij > such that the following holds. Let n > hq 
and consider the system with n queues. Let x be a queue-lengths vector such 
that ||x||i < cn and || 

x||oo ^ k — 1- Then, given — 
dTy{£{Xt),U)<e-'''"^ 
for all times t>ti = r/^^ In^ n. In particular, for n sufficiently large by (10) 

Pr(Mt, < A: - l|Xo = x) < e""^" + e"^'^''^. 

Thus, since the system is in equilibrium, for each z = 0, 1, . . . 

Pr(M(,+i),^ < k - l|<A.iJ < e-^' + e-"^'" 

on the event Di = < cn} {Mn^ l^k — 1}. Hence if we denote 

[n^/hl by io, 

Pr{{Z <k-l}nC) < Pr|^f]A^ 

«()-! / i \ 

< Fr{Do)l[Pr[D,+,\f]DA 

i=0 \ j=0 ) 

< exp(-(n^7ti)n-(^-^+°(i))) 
= exp(-n"+°(i)) 

— > as n ^ oo. 
Since C holds a.a.s., it follows that Z > k required. 

4. Concentration. In this section we prove concentration of measure re- 
sults for the queue-lengths process (Xt). Let n be a positive integer, and 
let ri be the corresponding set of queue-lengths vectors, that is, the set of 
nonnegative vectors in Z". Let us say that a real- valued function / on J7 is 
Lipschitz (with constant 1) if 

\f{x)- f{y)\ < \\x-y\\i 

for all x,y € 0. Let d be a fixed positive integer. The key result is the 
following lemma. 
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Lemma 4.1. There is a constant c > such that the following holds. Let 
n>2 be an integer and consider the n-queue system. Let the queue-lengths 
vector Y have the equilibrium distribution. Let f be a Lipschitz function on 
O. Then for each n > 

Pr(|/(y)-E[/(y)]|>u)<ne-^^/"'''. 

Recall that £{k, x) denotes \{j : x{j) >k}\, the number of queues of length 
at least k; and observe that for any fixed k this is Lipschitz as a function 
of X. We deduce from the last lemma the following result concerning the 
random variables i{k,Y). 

Lemma 4.2. Consider the n-queue system, and let the queue-lengths 
vector Y have the equilibrium distribution. For each nonnegative integer k 
let i{k) = E[i{k, Y)] . Then for any constant c > 0, 

Pr (^sup \£{k, Y) - £{k) I > ^^^2 ^ g-nQn^ n) _ 

Also, for each integer r > 2 

sup \B[e{k, YY] - £{kY I = 0{n'-^ In^ n). 
k 

Proof. We argue as in the proof of Lemma 5.2 of [7]. For the first part, 
let ci > Y^A' note that by Lemma 2.5 

Pr(£([cin],y) >0) =e-^('^). 

It follows that we may restrict attention to queue lengths k < ciu. For, since 
always l{k.,Y) < n we have ^([cin]) < 1 for n sufficiently large; and then 

¥y( sup |£(A:, y) -£(A:) I > l) <Pr(£( [cm], y) > 1) =e-^("). 

\A:>cin / 

Now the first part of the lemma follows easily from Lemma 4.1. 

For the second part, fix an integer r > 2. By Lemma 4.1 there is a constant 
C2 > such that, if we set u = C2n^/^lnn, then 

supPr(|^(A;,y) -£(fe)| >m) =o(n-''). 

k 

Hence, for each positive integer s < r. 



E[\£{k,Y) - i{k)\'] <u' + n'Pr{\£{k,Y) - i{k)\ >u) = u' + o(l), 
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uniformly over k. The result now follows from 
0<E[i{k,YY]-£{kY 

=j2Emk,Y)-mmkr-' 

s=2 

<j2B[\i{k,Y)-i{k)nn^-^ 

s=2 

= 0{n^-Hn^n), 

uniformly over k. □ 

Our proof of Lemma 4.1 will follow the lines of the proof of Lemma 5.1 
in [7]. The task is somewhat easier here, and we obtain tighter bounds, since 
for each fixed n the departures process has a bounded rate. Departures occur 
as events in a Poisson process at rate n, each one from an independently 
selected uniformly random queue, except that departures from empty queues 
are ignored. As in [7], along the way we prove concentration for Lipschitz 
functions of the time-dependent process for "nice" initial conditions — see 
Lemma 4.3 below. 

An overview of the proof is as follows. Consider a queue-lengths process 
{Xf) where Xq = 0. For t > 0, let Zt be the total number of arrivals in [0,t], 
and let Zt be the total number of departures in [0,t] (including "virtual 
ones," i.e., departures from empty queues). Thus Zt ~ Po{Xnt) and Zt ~ 
Point). Let fit = WiXt)], and fitiz,z) = E[f{Xt)\Zt = z,Zt = z]. We use 
earlier coupling results and the bounded differences method to upper bound 
Pr{\f{Xt) - fitiz, z)\ > u\Zt = z,Zt = z). 

Next we remove the conditioning on Zt and Zt- To do this, we choose 
suitable "widths" w and ti), and use the fact that Pr(|Zj — \nt\ > w) and 
Pr(|Zf — nt\ > w) are small, and for z, z such that \z — \nt\ <w, \z — nt\ < w 
the difference \fit{z,z) — /it| is at most about 4(zi; -|- w). We thus find that 
Pr {\f{Xt) — fJ-tl ^ ^{w + w)) is small. The part of the proof up to here is 
encapsulated in Lemma 4.3 below. Finally we use the mixing results, Theo- 
rem 1.1 and Lemma 2.1, to relate the distribution of Xt to the equilibrium 
distribution. 

Let us start on the details of the proof. In this section we shall use the 
following lemma with xq = 0; we consider more general initial states for later 
use. 

Lemma 4.3. There is a constant c > such that the following holds. Let 
n>2 be an integer and let f be a Lipschitz function on 0,. Let also xq^VL 
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and assume that the queue-lengths process (Xt) satisfies Xq = xq a.s. Then 
for all times t > and all u>0, 

(12) Pr(|/(Xt) - fit\ >u)< ?2e-'="'/('^*+"). 

Proof. Note first that we may assume without loss of generahty that 
/(xo) = 0, and so \f{Xt) \ < Zt + Zt, since we could replace f{x) by its trans- 
lation f{x) = f{x) — f{xo). Let z and z be positive integers, and condition 
on Zt = z and Zf = z. Now f{Xt) depends on 2{z + z) independent random 
variables Ti , . . . , , Di, . . . , Dz, Ti , . . . , , Di,. . . ,Dz which specify the ar- 
rival time and corresponding choice of d queues for each of z customers, 
and the z departure times and corresponding selections of a queue during 
[0,t]. This property relies on the well-known fact that conditional on the 
number of events of a Poisson process during [0,t], the arrival times are 
a sample of i.i.d. random variables uniform on [0,t]. Let T= {Ti, . . . ,Tz), 
T> = iDu...,Dz), T = (Ti,...,?^) and t) = (Di, . . . , Dz). We may write 
f{Xt) as 5(T,D,T,D) where 

5(t,d,t,d) =/(st(2;o,t,d,t,d)), 

in the notation of Lemma 2.3. 

We now prove that, conditional on Zt = z and Zf = z, the random vari- 
able f{Xt) is strongly concentrated, by showing that g{t,d,t,d) satisfies 
a "bounded differences" condition. Suppose first that we alter a single co- 
ordinate value dj or dj. Then the value of g can change by at most 2; by 
Lemma 2.3 starting at time tj with \\xtj — ytj ||i < 2. Similarly, if we change 
a coordinate value tj or tj, the value of g can change by at most 2; we may 
see this by applying Lemma 2.3 once at the earlier time and once at the 
later time. Now we use the independent bounded differences inequality; see, 
for instance, [12]. Hence, for each u>0 

Pr(|5(T, D, T, D) - E[g{T, D, T, D)] | > n) < 2exp 

In other words, we have proved that for any u > 

(13) Pr{\f{Xt)-fitiz,S)\>u\Zt = z,Zt = z)<2exp 

which is the desired upper bound on the quantity on the left-hand side. 

Next we will remove the conditioning on Zf. We will choose suitable 
"widths" w = w{n) > and w = w{n) > 0, where <w < Xnt and < w; < 
nt. Let / denote the interval of integer values z such that \z — Xnt\ < w; 
let / denote the interval of integer values z such that \z — nt\ <w. Since 
Zt ~ Po{\nt) and Zt ~ Po{nt), by inequalities (4) and (5), 

(14) Pr{Zt il)= Pr(|Zt - \nt\ > w) < 2exp 



( Mz + z)) 
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and 

(15) Pr {Zt ^ i) = Pr{\Zt-nt\>w)< 2 exp 



'SntJ' 

We shall assume that w > 2(Ant Inri)-*^/^ and w > 2(nt Inn)-*^/^, and so it 
follows by (14) and (15) that 

From Lemma 2.3, for each z 

(17) \fitiz + l,z)-fit{z,z)\<l 
and 

(18) \^it{z,z + l)-^it{z,z)\<l. 

We claim that for each z G / and z ^I, 

(19) \^it{z,z)-iit\<2{w + w) + o{l). 
To prove this, observe that 

l^t= ^it{z,z)PT{Zt = z,Zt = z) + B[f{Xt)l^Zt0}yj{Zt0}\- 

Hence by (16), since \ f{Xt)\ < Zt + Zt, 

Ht < max Antiz, z)} + B[{Zt + Z^)! 

zGl,zGl 

< max _{fitiz,z)} + o{l), 
zei,zei 

and by (14) and (15), 

Ht > min {nt{z, S)}Pr{Zt eI,Ztei)+ o(l) 

2:6/, ze/ 

> min _{;Ut(2;,z)} + o(l). 
zei,z€i 

Now we may use (17) and (18) to complete the proof of (19). By (13), (14), 
(15) and (19), 
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Pr{\f{Xt)-fit\>^w + w)) 

< Pr{\ f{Xt)-iJ.t\>3iw + yj)\Zt = z,Zt = z)Pr{Zt = z,Zt = z) 

z<^i,zei 

+ Pr{Zt^I)+PriZt^i) 

< Fr{\fiXt)- f,tiz,z)\>w + w + oil)\Zt = z,Zt = z) 

zei,zei 

X Pr{Zt = z,Zt = ~z) 
+ Pr(|Zt - \nt\ > + Pr(|Zi - ni\ > w) 

~ V 4:{Xnt + nt + w + w) J \ SXiit J "^V 3nt / 

Now let u and t satisfy 
(20) I2{nthinf/'^ <u<Q\nt. 

Let w = w = u/6. Then u = 3{w + w); and id and w are as required, that is, 
2 ( Ant In n)^/^ <w< Xnt and 2(ntlnn)^/^ <w <nt. Hence for n sufficiently 
large we have 



(21) Pr{\f{Xt)-tit\>u)<exp 



U4nt 



But if u < 12(nt Inn)^/^, then exp(— j^^) > n Thus, as long as u < 6Ant 
we have 

Pr(|/(Xi) - /iil > n) < nexp(^-^) . 

Now let us get rid of the upper bound on u. If 6Ant <u< Gent, then by the 
above of course 

Pr(l/(X,)-..|>,.)<nexp(-^|!). 

Finally consider u > 6ent. We saw that |/(Xt)| < Zt + Zt. Thus < 
E[\f{Xt)\] < (1 + A)nt < 2nt. Hence, if u > 6ent, then 

Pr{\f{Xt) -fit\>u)< Pr{\f{Xt)\ > 2n/3) 

< Pr{Zt > n/3) + Pr{Zt > u/3) 
<2Pr{Zt>u/3). 
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But Zi ~ Po{nt) and ii/3 > 2ent, and so by (6) the last bound is at most 
21-m/3^ The lemma now follows. □ 

We shall use Lemma 4.3 here with Xq = to complete the proof of 
Lemma 4.1. As we saw before, we may assume that /(O) = 0, and hence 
always < ||a;|[i. It remains to relate the distribution of Xi with X^ = 

to the equilibrium distribution. But by Theorem 1.1 there exists a constant 
?7 > such that, for each positive integer n and each time t > 0, if y has the 
equilibrium distribution, then we have d^y {C{Xt) , C{Y)) < ne~'^^ + 2e~''"'. 
Also, by Lemma 4.3 we may assume that r/ > is sufficiently small that, for 
each n, each t > and each u>0 

Pr(|/(y) - /i^l >u)< dTy{£{Xt),£{Y)) + Pr{\f{Xt) -fit\>u) 
<ne-^* + 2e-''"+nexp(^-^^ +ne~''"*. 

Further, we may assume that 77 > is sufficiently small that also Lemma 2.1 
holds with this value of rj. 

Now let K = max{l, ln~^(l/A)}, let u > 3nr]~^n^^'^ Inn and let t = n^^^'^u. 
Then 

= ryi > 3k Inn. 

nt 

Thus by the above, 

Pr(|/(y) -nt\>u)< 3ne-''* + 26"''". 
But fit = and so by Lemmas 2.1 and 2.4 

l/ii - E[/(y)]| < dw(/:(Xt), £(y)) = o(i), 

since Xq = and so 6n,t = 0, and rjt > 3k Inn. Thus we find that 

Pr(|/(y) - E[/(y)]| >u+l)< 3nexp(-7?n~i/2^) + 26"''" 

< (3n + 2)exp(-??n"^/2n) 

for all n sufficiently large and all 3Krj~^n^^^ Inn < u < n^/^. 

Let c= Note that ne~^'^ ^^^'^ > 1 for u < 3K7/~^n^/^ Inn. Hence, since 
also c<r], 

Pr(|/(y) - E[/(y)] I > n + 1) < (3n + 2) exp(-cn-^/2^) 

for all n sufficiently large and all < u < n^/^ . 

We may assume that < c < 1 . Then we may replace n + 1 by u if we 
replace c by c/2; that is, 

Pr(|/(y) -E[/(y)]| >u) < (3n + 2)exp(-(c/2)n-^/\) 
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for all n sufficiently large and all < n < m?/"^ . For if u < 2, then the right- 
hand side above is at least 1, and if u>2, then n > n/2 + 1. Now consider 
square roots: if we replace c by c/2 again, then we may replace the factor 
(3n + 2) by (3n + 2)^/^, which is at most n for n > 4. Thus, with a new c, 
we have 

Pr(|/(y) - E[/(y)]| > u) < nexp(-cn"^/\) 

for all n sufficiently large and all < n < n'^/^. One further minor adjustment 
to c lets us assert that the last inequality holds for all integers n > 2 and all 
0<u<n3/2. 

It remains only to consider values of u > n'^/^. But always \f{y) \ < ||y||i, 
and E[|ly||i] < j^n. Thus |/(y) - E[/(y)]| < \\Y\\i + j^n. Hence for n > 

Pr(|/(y) - E[/(y)]| >u)< Pr(||y||i > E[||y||i] + n/3) = e-^("), 

from the proof of Lemma 2.4 and a standard large deviations calculation for 
a sum of independent geometric random variables (see [5], pages 201-202), 
and so Lemma 4.1 follows. 

Lemma 4.3 is a quantitative version of some earlier results in [2, 3, 4, 13, 
14, 17]. It will also be used in [8] for analyzing the asymptotic distribution 
of the length of a given queue and for analyzing the "propagation of chaos." 

5. Balance equations and long-term behavior. In this section we consider 
the system in equilibrium, and present the key equation (24). We then show 
that the expected number of queues with at least i customers is close 
to nX^^'^'^ '"'^^ , and that the random number £{i,Yt) of queues with at 
least i customers stays close to this value over long periods of time. Here 
(Yt) is a queue-lengths process in equilibrium. We shall denote Iq by y 
below. As before, (Xt) will denote a queue- lengths process with a "time- 
dependent" distribution. Observe that A^"'"'^^ equals A* if d = 1, and 
equals xi'i' / i^-i) [f d>2. 

Let d be a fixed positive integer. Fix also a positive integer n, and consider 
the corresponding set of queue-length vectors. For x Gil and a nonnegative 
integer k, let u{k, x) be the proportion of queues j of length x{j) at least 
k. Thus always u{0,x) = 1. Let u{k) denote E[M(fc,y)]: thus u{k) =i{k)/n. 
We also let ut{k) = E[u{k,Xt)]. 

If / is the bounded function f{x) = u{k,x), then the generator operator 
A of the Markov process (see, e.g., [1], Section 1.1, and see also [17]) satisfies 

Af{x) = X{u{k - 1, x^ - u{k, xf) - {u{k, x) - u{k + 1, x)). 

[Compare with (1) earlier.] This is true, since u{k,x) — u{k + l,x) is the 
proportion of queues of length exactly k, and u{k — l,x)'^ — u{k,x)'^ is the 
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probability that the minimum queue length of the d attempts is exactly 
k — 1. From standard theory (see [1], Chapters 1 and 4), for each bounded 
function /, whatever the initial distribution of Xq, 

and so in particular, for each positive integer k, 

(22) = X{B[u{k - l,Xtf] - E[u{k,Xtf]) - {ut{k) - ut{k + l)). 
As Y is in equilibrium, 

(23) X(E[u{k - 1, y)^] - E[u{k, Yf]) - {u{k) - u{k + 1)) = 0. 

We shall consider only the equilibrium case for the remainder of this section, 
and rest our analysis on (23). Now 

1 " 1 
Y^u{k,x) = -^x(j) = 

k>l 3=1 

and so 

Y^u{k) = -E[\\YU<^. 

Hence u{k) ^ as A; — > oo. Also E[«(A:,y)'^] < u{k). Summing (23) for k>i 
we obtain, for each i = 1, 2, . . . , that 

(24) X'E[u{i-l,Y)'^]-u{i) = 0. 

(This is equivalent to saying that E[^/(y)] = 0, where f{x) is the number 
of customers with position at least i, but since / is not bounded we cannot 
assert the result directly.) Equation (24) is crucial to our analysis. 
Note first that by (24), n(l) = A, and for each i = 2,3 . . . 

n(z) = AE[u(i - 1, Y)'^] < \u{i - 1). 

Thus by induction on i 

(25) u{i) < X' for each i = 0, 1, 2, . . . . 

By (24) and the second part of Lemma 4.2, there exists a constant ci > 
such that for each positive integer n, 

(26) sup \u{i) - Xu{i - < cin"^ In^ n. 

i 

We claim that, for some constant C2 > 0, for each positive integer n 

(27) supl'u(i) - X^+d+-+d^-' I < C2n-i In^ n; 
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and hence 

(28) sup\i{i) - nAi+'^+-+^'"' I < C2 In^ n 

i 

for all positive integers n. 

Let us prove the claim. Note first that for x,y>0 we have 

\y'i - x'^l = \y- x\{y^-^ + y'^-^x + ■■■ + x'^-^) 

(29) 

<d{xUyy~'^\y - x\. 
Now by (25), u{i) < X' and X^+<i+-+d'-' < A\ so by (29), 

(30) < \u{i + 1) - Xu{if\ + X\u{if - {X^+d+-+d^~'y\ 

< \u{i + 1) - Xu{i)'^\ + Ad • A*('^-^)|u(*) - Ai+'^+-+'^'~' |. 
Since u(0) = 1, an easy induction on i using (26) and (30) gives 

for each i = 1,2, Let io be the least i such that Ad • A*^'^^^^ < 1/2. Let 

C2 = ci • max{2,EjL~o^(A(i)J}. Clearly 

\u{i)-X^+''+-+''""\<C2n~^ln^n 

for i = 0,1, . . . ,iQ. We shall prove by induction on i that this holds for all i. 
Let i>io and suppose that the inequality holds for i. Then by (26) and (30) 

\u{i + 1) - X^+d+-+d' I < c^n"^ In^ n + \c2'nr^ In^ n 

< C2n~^ In^ n, 

as required for the induction step. Thus we have proved the claim (27). 

This completes the first half of our task here. Now let X > be an arbi- 
trary constant, and let r = . We see next that all the coordinates l{i,Yt) 
are likely to stay close to throughout the interval [0, r]. 

Lemma 5.1. Let (Y^) he in equilibrium and let c> be a constant. Let 
Br be the event that for all times t with <t <t 

sup\e{i, Yt) - nAi+'^+-+'^'"' I < cn^/^ In^ n. 

i 

Then Pr(S;) <e-^(''^'"). 



28 



M. J. LUCZAK AND C. MCDIARMID 



Proof. By the first part of Lemma 4.2, there exists 7 > such that for 
ah n sufficiently large, for each time t > 



Pr 



(^sup Yt) - I > ^^^2 ^^4^ < ^-7 



Let s = cln^ n/ (8An^/^), let j = [r/s] and consider times rs for r = 0, . . . , j. 
The mean number of arrivals in a subinterval [(r — l)s,rs) is cn ' In^ n/8, 
so by (5) the probability that more than cn^/^ln^n/4 arrivals occur is at 
most e"'^"^ 2in2n/24 ^ ^-^\n^n ^ sufficiently large. Then 



Pr ( sup \£{i, Yt) - e{i) \ > cn^^^ In^ n/2 for some t G [0, r] 

, i 

< ^ Pr (sup Yrs) - > cn^^^ In^ n/4 



J 

r=0 
j 

+ ^ Pr([(r — rs) has > cn^^^ In^ n/4 arrivals) 

r=l 

<(r/s + 2)-2e"^''^'" 

< g-(7/2)ln2n 

for n sufficiently large. Now we can use (28). □ 

6. Lower bound on mixing times. In this short section we show that 
the upper bounds on the mixing times in Theorem 1.1 are of the right 
order, and in particular we prove (2). We do this by considering the total 
number of nonempty queues in the system. The idea is that this number is 
highly concentrated around its mean. In equilibrium the mean is An. On the 
other hand, if Xq = and t <9lnn, then the expected number of nonempty 
queues is less than (A — 6)n for a suitable constant 9. Thus for such t the 
two distributions are far apart. 

Now for the details. Consider two n-queue processes (Xt) and (It), where 
Xq = and (Yt) is in equilibrium. By Lemma 2.3, we can couple (Xt) and 
(Yt) in such a way that always Xt <Yt and so u{i, Xt) < u{i, Yt) for each i. In 
particular, if as before we let ut{i) = E[u{i, Xt)], then ut{i) < u{i). (Recall 
that u{i) = B[u{i,Yt)] = ^B[e{i,Yt)].) Let st(i) = u{i) - ut{i), so st{i) > 0. 
Also from (22) 

dt 

and 



X{l-B[u{l,Xt)''])-{ut{l)-ut{2)) 



= A(l-EKl,yt)'^])-(n(l)-n(2)), 
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SO that 



= -st{l) - A(E[u(l, Yt)''] - E[u{l, Xt)'']) + st{2). 



But, as in (29), given 0<y<x<l, we have 

x'^ - / = (x - y){x'^~^ + • • • + /-I) < d{x - y). 
Hence, since we may assume that always u{l,Xt) < u{l,Yt), we have 

EKl, Yt)'' - u{l,Xt)''] < d{u{l) - ut{l)) = dst{l). 
It follows [using also the fact that st{2) > 0] that for all t > 0, 

^^>-(l + AdK(l)^ 

Thus 

st{l) > Ae-(i+^'^)* 

for all times t>0, since sq{1) = n(l) = A. Thus if t < 2[i+xd) In n — ^^^^ In Inn, 
then si{t) > An~^/^ln^n, that is. 

An - E[£(l, Xt)] > An^/2 In^ n. 
But if t is O(lnn), then from (21) in the proof of Lemma 4.3, 

Pr{\e{l,Xt)- E[e{l, Xt)]\> n^/2 ln3/2 n) = e"^^^""' '^^ . 
Also, by the first part of Lemma 4.2, 

Pr{\£{l,Yt) - An| > ^An^/^ In^ n) = e"^^'"^'"^ 
Inequality (2) now follows. 

7. Proof of Theorem 1.3. We assume throughout that the process is in 
equilibrium. For each time t > and each z = 0, 1, . . . let the random variable 
Zt{i) be the number of new customers arriving during [0,t] with position at 
least i on arrival. Let Jo = and enumerate the arrival times after time as 

Ji, J2, We define a "horizon" time to = In^ n, and let N = [2Aniol • Note 

that i{l,Yt) is the number of nonempty queues at time t. For each time t, 
let At be the event 

{An/2 <^(l,y,) < 2An Vs G [0,t]}. 

Then by Lemma 5.1, the event Atg holds a.a.s. 

We need two more preliminary results. The first one is an analogue of a 
special case of Lemma 2.1 in [7]. It may be proved quickly along the lines of 
the proof of that lemma; for completeness we give a proof here. 
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Lemma 7.1. Let (Xt) be in equilibrium. Let s,t>0 and let a,b be non- 
negative integers. Let S = n{Xds)^~^^ / {b + 1)!. Then 

(31) Pr[Mt < a for some t G [0, r]] <(^^ + lj (Pr(Mo < a + 6) + <5) 
and 

(32) Pr [Mi > a + 5 for some t G [0, r]] < (^^ + 1^ (Pr(Mo >a) + 5). 

Proof. The j = [^J + 1 disjoint intervals [(r — l)s,rs) for r = 1, . . . ,j 
cover [0,r]. Let Cr denote the event of having at least 6+1 arrivals in the 
interval [(r — l)s,rs) which are placed into a single bin. Then 

Pr{Cr) < nPr{Po{Xds) >b + l)<6. 

But 

{Mt < a for some t G [0, r]} C |^ |J {M„ < a + 6}^ U |^ |J C,.^ 
and (31) follows. Similarly 

{Mt>a + b for some t G [0, r)} C |^ |J {M„ > a}^ U f |J Cr^) 

\r=0 / \r=l / 

and (32) follows. □ 

We shall use the second lemma to bound "initial" effects. For each time 
t > let St be the event that some initial customer survives at least to 
time t. 



Lemma 7.2. Let < A < 1 and let d be a positive integer. Let a 



min{iln(-v), i}, so a > 0. Then for each positive integer n and each time 



t >0, 

Pr(5j) <2ne"°*. 

Proof. Let k = \ t/A\ . By (25) 

Pr(Mo > A; + 1) < nA^+^ < nA*/^ 



Let Z be distributed like the sum of k independent service times. Thus Z 
has a gamma distribution, and has moment generating function E[e'^^] = 
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(1 — s) for s < 1. So by Markov's inequality, for each < s < 1, 
Pr(Z>t) <e-*"(l-s)-'= 

= e"*/^2'' taking s = - 

Hence 

Pr(5t) < Pr(Mo > /c + 1) + nPr(Z > t) < nA*/"^ + ne"*/^ < 2ne-"*. □ 

Let i* = i*{n) be the smallest integer such that X^'^'' < n^^/^ln^n 
(see the discussion following Theorem 1.3). Note that i* = lnlnn/ln(i + 0(l). 

We can handle the lower bound on Mt easily. By Lemma 5.1, Fr(M < 
i* — 1) = e-^Cii^"). In particular M >i* -1 a.a.s. Further, (31), with t = n^ , 
a = i* — 3, 6=1 and s = n~^~^, shows that 

(33) min{Mt :0<t< n^} >i* -2 a.a.s., 

since 

5 = nPr{Po{Xds) > 2) < n{\dsf = 0{n-^^-^). 

This result establishes the lower bound half of (3). 

The upper bounds on Mt are less straightforward to prove. We consider 
first the easier case when d > 3. 

7.1. The case d>3. We shall show that M <i* a.a.s. For A: = 0, 1, . . . , let 
Ek be the event that £{i*,Yji^) < 2n^/^ln^n; that is, at time (just after) 
there are no more than 2n^/^ In^ n queues with at least i* customers. Then 
Fr{Ek) = e~^(''^ by Lemma 5.1. Consider the customer who arrives at 
time Jk- on E^-i, he has probability at most pi = {2n~^^^ln^ n)'^ of joining 
a queue of length at least i* . Note that 

Pr(J7v+i < to) < Pr[Po{Xnto) > 2Anto] = g-^^"^''""). 
Also, for each positive integer r, 

Pr{B{N,pi) >r)< {NpiY = 0{{n-^'^/'^~^\lnnf'^+y). 
Hence, for each positive integer r, 

Pr[Zt,{e + l)>r] 

< Pr{B{N,pi) >r) + Pr( [jEi:]+ Pr(J^+i < to) 
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Also, by Lemma 7.2 there exists a constant a > such that the probabihty 
that some "initial" customer has not departed by time to is at most 2ne~"*° . 
Hence, for each positive integer r, 

Pr[M >i* + r]< Pr[Zt„(i* + 1) > r] + 2ne"°*o. 

In particular, Pr(M > i* + 1) = o(l), which together with the earlier result 
that M >i* — 1 a.a.s. completes the proof that M is concentrated on at 
most the two values i* and i* — 1. Also, 

(34) Pr[M>r + 2K + 5] =o(n-^-2). 

Now (32), with t = n^ , a = i* + 2K + 5, b = \K/2] + 1 and s = n'^, lets us 
complete the proof of (3), since 

6 = nPr{Po{Xds) >b + l)< n{Xds)^/^+^ = 0{n-^-^). 

7.2. The case d = 2. The case d = 2 needs a little more effort, and uses 
the "drift" results from Section 7 in [7]. For convenience we restate these 
results here, as the next two lemmas. The first lemma concerns hitting times 
for a generalized random walk with "drift." 

Lemma 7.3. Let 0o ^ ^ ■ ■ ■ ^ 'Pm be a filtration, and letYi,Y2, . . . , 
be random variables taking values in {—1,0,1} such that each Yi is (pi- 
measurable. Let Eq, El, . . . , Em-i be events where Ei € for each i, and 
let E = ^iEi. Let R^. = Rq + Ei=i^i- Let < p < 1/3, let ro and n be 
integers such that ro < ri and let pm > 2(ri — ro). Assume that for each 
i = 1, . . . ,m, 

Pr {Yi = l\^i^i) > 2p on Ei^i n {Ri^i < n} 

and 

Pr{Yi = -l\^i-i) <p on Ei.i n {Ri^i < n}. 

Then 

Pr{En{Rt<ri Vt G {1, . . . , m}}|i?o = ^o) < exp 

The second lemma shows that if we try to cross an interval against the 
drift, then we will rarely succeed. 

Lemma 7.4. Let a be a positive integer. Letp and q be reals with q> p>0 
and p + q < 1. Let (po ^ (pi '!= ^2 ^ ' ' ' be a filtration, and let ^1,12) . ■ . be ran- 
dom variables taking values in {—1,0,1} such that each Yi is (pi-measurable. 
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Let Eq,Ei, . . . be events where each Ei & (pi, and let E = f]^Ei. Let Rq = 
and let R/^ = J2i=i ^ k = 1,2, . . . . Assume that for each i = 1,2, . . . , 

Pr{Yi = <p on Ei^i n {0 < < a - 1} 

and 

Pr{Yi = >q on Ei^i n {0 < < a - 1}. 

Let 

T = ml{k>l:Rk G {-l,a}}. 

Then 

Pr{En{RT = a})<{p/qr. 

Having stated the two "drift" lemmas, let us resume the proof for the 
case d = 2. Still let to = In^ n and = \2XntQ] . We first show that M>i*, 
by showing that in fact 

(35) i{i*,YtJ>ln^n a.a.s. 

Let Jq = 0, and enumerate all jump times after time (not just the arrival 
times) as J( , J2, For A; = 0, 1, . . . let E^ be the event that £{i* — 1, YjrJ > 

\n^^'^ In^ n; and let E'^, be the event that ^(z*, Ij/ ) < 21n'^ n. By Lemma 5.1 as 

before, Pt{E^) = g-^P"""). Let Vk = Hi*,Yj> ) - £(i*,Yj, ) for k = l,2,..., 

k k — 1 

so that 

k 

i{i*,Yj,)=i{e,Yo) + Y.V,. 

i=i 

Let p2 = ln^n/(25n). On n E^-i (1 E'f^_^, 

FriVk = l\cl)j'^J>2p2 

and 

Pr{Vk = -l\^r^J<P2, 

for n sufficiently large. 

Also then np2 > 41n^ n for n sufficiently large. Hence by Lemma 7.3, a.a.s. 
£{i* ,Yjr) > 21n'^n for some i <n. Also < to a.a.s., since 

Pr(j; > to) < Pr(J„ > to) = Pr(Po(Anto) < n) = e-^^''^''" 

Thus 

£{i* , i^t ) > 2 In^ n for some t € [0, to] . 
It now suffices to show that a.a.s. there will be no "excursions" that cross 
downward from [21n^n] to at most In^n during the interval [0,r]. Let B be 
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the event that there is such a crossing. The only possible start times for such 
a crossing are departure times during [0,to]) and a.a.s. there are at most 
such times. We may use Lemma 7.4 to upper bound the probability that 
any given excursion leads to a crossing. Let a = [In^ n] . Let p = P2 and let 
q = 2p2- We apply the lemma with replaced by —V^ and with a, p and q 

as above, and with the events = Aji n Ek- We obtain 

fc 

Pr(B) < iV2-" + Pr f y ^"j + o(l) = o(l). 

Thus we have proved that M >i* a.a.s. 

We now consider upper bounds on M. We shall show that M <i* + 1 
a.a.s., by showing that + 2, Yf^) = a.a.s. For k = 0,1, . . . , let Fk be 
the event that at the arrival time Jk there are no more than 2n^/^ In^ n 
queues of length at least i* . By Lemma 5.1 we have Pr(Fk) = e"^^'"^ 
Consider the customer arriving at time J^: on -Ffc_i he has probability at 
most ps = Aln^n/n of joining a queue of length at least i* . Thus for each 
positive integer r, 

Pr(Zt, (r + 1) > r) < ¥v{B{N,p^) >r) + ¥v([jF^\+ Vv{Jn+i < to). 

\k=0 ) 

Also, by Lemma 7.2 the probability that some "initial" customer has not 
departed by time to/2 is at most 2ne~"*°/^ for a suitable constant a > 0. 
Hence, there is a constant c such that with probability 1 — e"^^''^ we have 
+ \,Yt) < cln^n uniformly for all t G [to/2, to]- Thus this also holds over 
[0,to]. 

For /c = 0,1,..., let F'^ be the event that + l,ljj < cln'^n; that 
is, at time Jfc there are no more than cln^n queues with at least + 1 
customers. On Fl^_^, the customer arriving at time Jk has probability at 
most p4 = (In n)^^n~^ of joining a queue of length at least i* + 1. Then for 
each positive integer r, 

Pr{Zt, {t* + 2) > r) < Pr(B(iV,p4) > r) + \J jA + Pr( Jat+i < to). 

\ A:=0 / 

Also, by Lemma 7.2, the probability that some initial customer stays until 
time to is at most 2ne~°*''. It follows that a.a.s. Af^g < i* + 1, and 

(36) Pr{Mto>i* + K + 5) = 0{n~^'-'^). 

Now the inequality (32) in Lemma 7.1 with r = , a = i* + K + 5, b = \K/2] + 1 
and s = yields the upper bound part of (3), since 

6 = nPr{Po{Xds) >b + l)< n{Xdsf+^ = 0{n-^-^). 
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Finally, let us note one result which will be useful in [8]. Let the integer 
d > 2 be fixed. Then, as in (36), if r = O(lnn), 

(37) Pr(M>r + l + r) = 6-^(^1°'^). 

8. Concluding remarks. We have investigated the well-known "super- 
market" model with n servers and a fixed number d of random choices. We 
have shown that the system converges rapidly to its equilibrium distribu- 
tion. Our main result is that, for d>2, in equilibrium the maximum length 
of a queue is a.a.s. concentrated on two adjacent values close to Inlnn/lnd. 
In contrast, when d = 1 the maximum length of a queue is a.a.s. close to 
Inn/lnlnn. Along the way we used the fact (27) that, in equilibrium, for 
each nonnegative integer k the proportion of queues of length at least k is 
close to xi+d+-+d''-\ 

In [8] we use this last result together with mixing and concentration es- 
timates (and upper bounds on the maximum length of a queue) obtained 
here to prove quantitative results on the convergence of the distribution of 
a queue length. In particular, we give a quantitative version of the conver- 
gence result mentioned in the Introduction. Let {vt{k) :k £N) be as in (1) 
above. It turns out that, for suitable initial conditions, uniformly over all 
t > the distribution of a given queue length at time t is close in total 
variation distance to the distribution of an integer-valued nonnegative ran- 
dom variable Vt such that Pr(Vf >k) = vt{k). Also in [8] we investigate the 
asymptotic independence of small subsets of queues, the "chaotic behavior" 
of the system. 
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